Evaluating group-sequential non-inferiority clinical trials following interim stopping: The HIV Prevention Trials Network 083 trial.

BACKGROUND/AIMS: The HIV Prevention Trials Network 083 trial was a group-sequential non-inferiority trial designed to compare HIV incidence under a novel experimental regimen for HIV prevention, long-acting injectable cabotegravir, with an active-control regimen of daily oral tenofovir disoproxil fumarate/emtricitabine (brand name Truvada). In March of 2020, just as the trial had completed enrollment, the COVID-19 pandemic threatened to prevent trial participants from attending study visits and obtaining study medication, motivating the study team to update the interim monitoring plan. The Data and Safety Monitoring Board subsequently stopped the trial at the first interim review due to strong early evidence of efficacy. METHODS: Here we describe some unique aspects of the trial's design, monitoring, analysis, and interpretation. We illustrate the importance of computing point estimates, confidence intervals, and p values based on the sampling distribution induced by sequential monitoring. RESULTS: Accurate analysis, decision-making and interpretation of trial results rely on pre-specification of a stopping boundary, including the scale on which the stopping rule will be implemented, the specific test statistics to be calculated, and how the boundary will be adjusted if the available information fraction at interim review is different from planned. After appropriate adjustment for the sampling distribution and overrun, the HIV Prevention Trials Network 083 trial provided strong evidence that the experimental regimen was superior to the active control. CONCLUSIONS: For the HIV Prevention Trials Network 083 trial, the difference between corrected inferential statistics and naive results was quite small-as will often be the case-nevertheless, it is appropriate to report and publish the most accurate and unbiased statistical results.

A platform trial design for preventive vaccines against Marburg virus and other emerging infectious disease threats.

BACKGROUND: The threat of a possible Marburg virus disease outbreak in Central and Western Africa is growing. While no Marburg virus vaccines are currently available for use, several candidates are in the pipeline. Building on knowledge and experiences in the designs of vaccine efficacy trials against other pathogens, including SARS-CoV-2, we develop designs of randomized Phase 3 vaccine efficacy trials for Marburg virus vaccines. METHODS: A core protocol approach will be used, allowing multiple vaccine candidates to be tested against controls. The primary objective of the trial will be to evaluate the effect of each vaccine on the rate of virologically confirmed Marburg virus disease, although Marburg infection assessed via seroconversion could be the primary objective in some cases. The overall trial design will be a mixture of individually and cluster-randomized designs, with individual randomization done whenever possible. Clusters will consist of either contacts and contacts of contacts of index cases, that is, ring vaccination, or other transmission units. RESULTS: The primary efficacy endpoint will be analysed as a time-to-event outcome. A vaccine will be considered successful if its estimated efficacy is greater than 50% and has sufficient precision to rule out that true efficacy is less than 30%. This will require approximately 150 total endpoints, that is, cases of confirmed Marburg virus disease, per vaccine/comparator combination. Interim analyses will be conducted after 50 and after 100 events. Statistical analysis of the trial will be blended across the different types of designs. Under the assumption of a 6-month attack rate of 1% of the participants in the placebo arm for both the individually and cluster-randomized populations, the most likely sample size is about 20,000 participants per arm. CONCLUSION: This event-driven design takes into the account the potentially sporadic spread of Marburg virus. The proposed trial design may be applicable for other pathogens against which effective vaccines are not yet available.

Reliably Assessing Duration of Protection for Coronavirus Disease 2019 Vaccines.

Decision making about vaccination and boosting schedules for coronavirus disease 2019 (COVID-19) hinges on reliable methods for evaluating the longevity of vaccine protection. We show that modeling of protection as a piecewise linear function of time since vaccination for the log hazard ratio of the vaccine effect provides more reliable estimates of vaccine effectiveness at the end of an observation period and also detects plateaus in protective effectiveness more reliably than the standard method of estimating a constant vaccine effect over each time period. This approach will be useful for analyzing data pertaining to COVID-19 vaccines and other vaccines for which rapid and reliable understanding of vaccine effectiveness over time is desired.

SARS-CoV-2 Variants and Vaccines.

Viral variants of concern may emerge with dangerous resistance to the immunity generated by the current vaccines to prevent coronavirus disease 2019 (Covid-19). Moreover, if some variants of concern have increased transmissibility or virulence, the importance of efficient public health measures and vaccination programs will increase. The global response must be both timely and science based.

COVID-19 vaccine trials: The potential for "hybrid" analyses.

BACKGROUND: Although several COVID-19 vaccines have been found to be effective in rigorous evaluation and have emerging availability in parts of the world, their supply will be inadequate to meet international needs for a considerable period of time. There also will be continued interest in vaccines that are more effective or have improved scalability to facilitate mass vaccination campaigns. Ongoing clinical testing of new vaccines also will be needed as variant strains continue to emerge that may elude some aspects of immunity induced by current vaccines. Randomized clinical trials meaningfully enhance the efficiency and reliability of such clinical testing. In clinical settings with limited or no access to known effective vaccines, placebo-controlled randomized trials of new vaccines remain a preferred approach to maximize the reliability, efficiency and interpretability of results. When emerging availability of licensed vaccines makes it no longer possible to use a placebo control, randomized active comparator non-inferiority trials may enable reliable insights. METHODS: In this article, "hybrid" methods are proposed to address settings where, during the conduct of a placebo-controlled trial, a judgment is made to replace the placebo arm by a licensed COVID-19 vaccine due to emerging availability of effective vaccines in regions participating in that trial. These hybrid methods are based on proposed statistics that aggregate evidence to formally test as well as to estimate the efficacy of the experimental vaccine, by combining placebo-controlled data during the first period of trial conduct with active-controlled data during the second period. RESULTS: Application of the proposed methods is illustrated in two important scenarios where the active control vaccine would become available in regions engaging in the experimental vaccine's placebo-controlled trial: in the first, the active comparator's vaccine efficacy would have been established to be 50%-70% for the 4- to 6-month duration of follow-up of its placebo-controlled trial; in the second, the active comparator's vaccine efficacy would have been established to be 90%-95% during that duration. These two scenarios approximate what has been seen with adenovirus vaccines or mRNA vaccines, respectively, assuming the early estimates of vaccine efficacy for those vaccines would hold over longer-term follow-up. CONCLUSION: The proposed hybrid methods could readily play an important role in the near future in the design, conduct and analysis of randomized clinical trials performed to address the need for multiple additional vaccines reliably established to be safe and have worthwhile efficacy in reducing the risk of symptomatic disease from SARS-CoV-2 infections.

A Deferred-Vaccination Design to Assess Durability of COVID-19 Vaccine Effect After the Placebo Group Is Vaccinated.

Multiple candidate vaccines to prevent COVID-19 have entered large-scale phase 3 placebo-controlled randomized clinical trials, and several have demonstrated substantial short-term efficacy. At some point after demonstration of substantial efficacy, placebo recipients should be offered the efficacious vaccine from their trial, which will occur before longer-term efficacy and safety are known. The absence of a placebo group could compromise assessment of longer-term vaccine effects. However, by continuing follow-up after vaccination of the placebo group, this study shows that placebo-controlled vaccine efficacy can be mathematically derived by assuming that the benefit of vaccination over time has the same profile for the original vaccine recipients and the original placebo recipients after their vaccination. Although this derivation provides less precise estimates than would be obtained by a standard trial where the placebo group remains unvaccinated, this proposed approach allows estimation of longer-term effect, including durability of vaccine efficacy and whether the vaccine eventually becomes harmful for some. Deferred vaccination, if done open-label, may lead to riskier behavior in the unblinded original vaccine group, confounding estimates of long-term vaccine efficacy. Hence, deferred vaccination via blinded crossover, where the vaccine group receives placebo and vice versa, would be the preferred way to assess vaccine durability and potential delayed harm. Deferred vaccination allows placebo recipients timely access to the vaccine when it would no longer be proper to maintain them on placebo, yet still allows important insights about immunologic and clinical effectiveness over time.

COVID-19 vaccine trials: The use of active controls and non-inferiority studies.

BACKGROUND: Recently emerging results from a few placebo-controlled randomized trials of COVID-19 vaccines revealed estimates of 62%-95% relative reductions in risk of virologically confirmed symptomatic COVID-19 disease, over approximately 2-month average follow-up period. Additional safe and effective COVID-19 vaccines are needed in a timely manner to adequately address the pandemic on an international scale. Such safe and effective vaccines would be especially appealing for international deployment if they also have favorable stability, supply, and potential for implementation in mass vaccination campaigns. Randomized trials provide particularly reliable insights about vaccine efficacy and safety. While enhanced efficiency and interpretability can be obtained from placebo-controlled trials, in settings where their conduct is no longer possible, randomized non-inferiority trials may enable obtaining reliable evaluations of experimental vaccines through direct comparison with active comparator vaccines established to have worthwhile efficacy. METHODS: The usual objective of non-inferiority trials is to reliably assess whether the efficacy of an experimental vaccine is not unacceptably worse than that of an active control vaccine previously established to be effective, likely in a placebo-controlled trial. This is formally achieved by ruling out a non-inferiority margin identified to be the minimum threshold for what would constitute an unacceptable loss of efficacy. This article not only investigates non-inferiority margins, denoted by δ, that address the usual objective of determining whether the experimental vaccine is "at least similarly effective to" the active comparator vaccine in the non-inferiority trial, but also develops non-inferiority margins, denoted by δo, intended to address the worldwide need for multiple safe and effective vaccines by satisfying the less stringent requirement that the experimental vaccine be "at least similarly effective to" an active comparator vaccine having efficacy that satisfies the widely accepted World Health Organization-Food and Drug Administration criteria for "worthwhile" vaccine efficacy. RESULTS: Using the margin δ enables non-inferiority trials to reliably evaluate experimental vaccines that truly are similarly effective to an active comparator vaccine having any level of "worthwhile" efficacy. When active comparator vaccines have efficacy in the range of 50%-70%, non-inferiority trials designed to use the margin δo have appealing properties, especially for experimental vaccines having true efficacy of approximately 60%. CONCLUSION: Non-inferiority trials using the proposed margins may enable reliable randomized evaluations of efficacy and safety of experimental COVID-19 vaccines. Such trials often require approximately two- to three-fold the person-years follow-up than a placebo-controlled trial. This could be achieved, without substantive increases in sample size, by increasing the average duration of follow-up from 2 months to approximately 4-6 months, assuming efficacy of the active comparator vaccine has been reliably evaluated over that longer duration.

Clinical Endpoints for Evaluating Efficacy in COVID-19 Vaccine Trials.

Several vaccine candidates to protect against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection or coronavirus disease 2019 (COVID-19) have entered or will soon enter large-scale, phase 3, placebo-controlled randomized clinical trials. To facilitate harmonized evaluation and comparison of the efficacy of these vaccines, a general set of clinical endpoints is proposed, along with considerations to guide the selection of the primary endpoints on the basis of clinical and statistical reasoning. The plausibility that vaccine protection against symptomatic COVID-19 could be accompanied by a shift toward more SARS-CoV-2 infections that are asymptomatic is highlighted, as well as the potential implications of such a shift.

Achieving effective informed oversight by DMCs in COVID clinical trials.

Best practices of data monitoring committees (DMCs) in randomized clinical trials are well established. Independent oversight provided by DMCs is particularly important in trials conducted in public health emergencies, such as in HIV/AIDS or coronavirus epidemics. Special considerations are needed to enable DMCs to effectively address novel circumstances they face in such settings. In the COVID-19 pandemic, these include the remarkable speed in which data regarding benefits and risks of interventions are accumulated. DMCs must hold frequent virtual meetings, using state-of-the-art communication software that protects against risk for security breaches. Data capture and DMC reports should be focused on the most informative measures about benefits and risks. Because numerous clinical trials are being concurrently conducted in the COVID-19 setting, often addressing closely related scientific questions, structures for DMC oversight should be efficient and adequately informative. When these concurrently conducted trials are evaluating related regimens in related clinical settings, often individually underpowered for safety and having separate DMCs, processes should be implemented enabling these DMCs to share with each other emerging confidential evidence to better assess risks and benefits. Ideally a single DMC would monitor a portfolio of clinical trials or a trial with multiple arms, such as a platform trial.